Papers with graph-structured reasoning habit
Self-attention-based Graph-of-Thought for Math Problem Solving (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for generating reasoning paths in a chain structure are inefficient and non-human-like. |
| Approach: | They propose a decoding method for a chain-based LLM that constructs a thought graph simultaneously as an LLM inference and generates reasoning steps with a graph-structured self-attention mechanism. |
| Outcome: | The proposed method improves reasoning accuracy without huge computational over-expensive LLMs and avoids performance degradation issues when the LLM is too small to comprehend complex prompts. |